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GQVERNMRTvfr RTO WTS CLATTSR 
This invention was made ^vith Government support under Contract Numbers N-61339- 
01<:-1008 and N.6l339-98^-0036 awarded by the Naval Air Warfere Center Training 
Systems Division of Orlando, FL. The CSovemment has certain rights in the invention. 

FIELD OF THP. INVENTTON 
niis invention relates to training firefighters in an augmented reality (AR) simulation that 
includes creation of graphics depicting fire, smoke, and application of an extinguishing agent; 
extinguishing agent interaction with fire and airborne particles; applying computer generated 
extinguishing agent via an instiinnented and niggedized fiiefighter»s nozzle; displaying the 
simulated phenomena anchored to real-world locations as seen through an instmmented and 
mggedized head-worn dispby; and occlusion of virtual objects by a r«al person and/or other 
moveable objects. 

COPYRTaWT TKTI?ni?A>rATri^T.j 
A portion of the disclosure of this patent document contains material that is subject to 
copyright protection. The copyright owner has no objection to the fecsimile reproduction by 
anyone of the patent document or the patent disclosure as it appears in the Patent and 
Trademark Office records but otherwise reserves all copyright works whatsoever. 

BACKGROUND OP T RE INVHNTrOTsT 
Current fire simulation for firefighter training is accomplished at fecilities that use propane 
burners and extinguishing agent collectors to simulate the behavior of various types of fires 
Tbis approach presents nmnerous disadvantages, such as safety risks attributable to 
umntended reflash and explosion; enviromnental damage attributable to combustion 
byproducts; health risks to crews due to inhalable combustion byproducts; high operation 
costs attributable to &el requirements; high maintenance costs to ensure system integrity and 
safety; and unrealistic fire simulations for some types of fires (aU simulations appear as 
propane fires as opposed to oil. electrical or paper; and simulated smoke is white instead of 
black). 

A need exists for a new generation of fire fighting/damage control simulation system 
whrch does not use live fires. These systems must be capable of providing a high fidelity 
representation of the smoke and flames, as weD as a reaUstic representation of the 
enviromnent (to include feHow crew members). Augmented xeality (AR) technology aUows 
overlay of computer-generated graphics on a person's view of the real world. With AR. 
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w J still allovring ttatoecs » view a«i ta«»C »«. e»=l. 

l^HL ™slal.n. .an . done .K. ~ ^ - ^ t^^ll^r^ 
°ui™»n. «». would *e used in a real wodd »«.rio. For «.mpl.. fi"*^ 
rr,T4:andn.a^«.«.....-»-e.e«..^«»-^ 

can be lns»«n.en,ed n,.as„« d.eir posiH.- onen..«o» - 
aadition. fl^se i.^ should n.gged so *=y ngorous 
"undergo In a real operational environment •««. Inctadea 

slK^. and pene^ation ^n. con«n.^«, such as d« wa^ ^a allows sal.. 
c^a^ve«ainingwiti.sre.«rreaIisn.fl^purevirti.a.r«H.y(VR)snnutation. 

Th. n^jori„ of current generation fire fighting tiafaing systems use bve, pr^b«ed 
^ which are unsafe, particularly for use in contained area, such as o^ sh^ ™^ 
^istn^ l.a.xaini„genvi.onmen.,ti.euseofUvep.op»«^flr.spres«>.ss.i«y. 

health and environmental risks. 

Th. prhnary ohjective of tins invention is to development of an augmen.«l rc^^ 
ttahnng (AEBT) system for fixe fighting, witi. application «. rescue and hazardous matenal 
nntigation. In ftct. in any fire situation »e multiple goals, inctadmg: 

• Search, rescue, and extrication 

• Ingress into, and egress from, a structure 

• Fire suppression 

• Structure stabUization 

• Team coordination - command & control 

• Fire cause determination 

m each of ^ goals, firefighter engage in a ^mber of cognitive and physical tasks 
c^tical to the survival of both fixe victinu. and firefi^. as weU as to the to^^ 

sion of a file. Tasks Aat fell under this category are 

(1) Navigation 

(2) Situation awareness 

(3) Decision making/problem solvit^ 

(4) Stress management 

These tasks are undertaken, usually in concert wilh one another, to achieve the above 
goals. Trainmg in these four tasks provides die foundation for a firefighter to combat any fiie 
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situation. An opportunity exists to develop an ARBT system which educates firefi^teis in 
ttiese tasks in a safe and potentially less e7q)ensive environment, in afanost any location. 

It is important at this juncture to distinguish between the concept of reaction versus 
interaction wifli fire and smoke. By reaction we connote responses made by a firefighter to 
conditions caused by fire and smoke; in this situation he/she does not alter the evolution of 
flie fire and smote. By interaction we mean that the firefighter directly affects the evolution 
of the fire and smoke by such actions as fire suppression and ventilatiorL As stated above. 
Tasks (1) to (4) are applicable to any fire situation - reactive or interactive. Therefore, any 
significant improvement in developing training skills for Tasks (1) to (4) will result in a 
significantly skilled firefighter for both reactive and interactive scenarios. 

To preserve Ihe fideUty of an ARBT simulation in vMch. interaction is to take place, flow 
from a nozzle should affect airflow in an environment and cause motion of aerosols and gases 
to be affected. To allow for real-time simulation, such an effect should have considerably 
less computational cost lhan a computational fluid dynamics (CFD) simulation. This aspect 
of the invention also applies to graphical components other than fire and smoke, including 
ambient steam, ambient smoke, visible fumes, invisible fimies, apd^pflier aerosols, gases, and 
particulate matter. 

In order to improve realism, it is also lifeiigsaiy for real objecte to occlude virtual objects. 
To do this, virtual models of such real objects must be created that correspond in space and 
time to the location of the real objects. One problem with traditional modeling techniques is 
that hard edges introduced by polygonal models can be distracting if there is misregistration 
in augmented reality due to tracking errors and lag. 

SUMMARY OF THE TNVK^ mnM 
An objective of Ihis invention is to demonstrate the feasibility of augmented reality as 
the basis for an untethered, ARBT system to train firefighters. Two enabling techn ologies 
wiU be exploited: a flexible, wearable belt PC and an augmented reaUty head-moiihted 
display (HMD). Specifically, the HMD can be integrated with a firefighter's SCBA. This 
augments the experience by allo^dng the user to wear a real firefighter's SCBA (Self- 
Contained Breathing Apparatus) while engaging in computer-enhanced fire training 
situations. Key aspects of the this feature include (1) a real firefighter's SCBA, including 
catcher's mask-style straps, which gives the user the sensation of being in a real firefighting 
situation, (2) a head motion tracker, which is mounted on the SCBA to track the position and 
orientation of the firefighter's head, (3) a speciaUy mounted camera and mirror or camera and 
prism configuration which takes a video image of what is directly in firont of the user's eyes. 
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(4) a video <HspUy screan. which U used U> ^-^^^^'^'^Zc^^^ 
J- in ^n. ofWs .yes. (5) .^^^ ^^^^ 

^^i..app„pHa..uadsinto.hefi.B..»-»»«. ,u«>«nno„.*eu^ would 

fi«.fiahter's vari-nozzle, instrumented and ruggedized for use. 

olfectory) are dynamically superimposed on sensory 
stimuU (e.g. visual, acoustic, theraial, oliactory; a 

-^^Z^t:^ . — d^eiopin. a p...,P. — 
awareness. (3) stress management, and (4) problem somng. my 

"cL be not only a low-cost fining tool for fire academies and — ty^ 

~ts.l,utalso^.desatestl,edforevaluating.turefi^^^^^^ 

Tdecision aids, heads-up displays, and global positioning systems for the 21st cen^ 

^ •^f.r^nARBT system is the training of firefighters in 
Accordingly, ffie primary opportumly for an ARBT system is 

the areas of Tasks (1) to (4) above for reactive scenarios. 

Significance of the Opportunity 

• Increased safety 

• Increased task performance 

• Decreased workload 

• Reduced operating costs ^ ^ t^i * 

^ ^ p^ ata. - i— ^--^ « '^"^ ^""'^ " 

e,.,^ any file department, large or snuOl. wl««« on taKt a.r. ot 

Z^ml Mll- Wnt— --'--^ A«gn«n.ed.aU.y.^^- 

'Z7f an effeo^r^inin. r^^-^ '^-^ '-^^^ 

"Lily conaideraaona of d- =on^««ona. eomplexity and d. nun.h« ofj^ 

^hyd^^ainingexerciaes. Becanaeofd. value o«ftefigh.«smTaa..(.)«, 
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(4) for any fiie situation, and because the program enqihasizes fiiefi^ter reactions to (vs. 
interactions with) fire and smoke, training scenarios can be precomputed. 

As described elsewhere in this docmnent, models exist which can predict the evolution of 
fire and smoke suitable for training applications. An opportunity exists to exercise Aese 
models off line to compute reactive fire fighting scenarios. These precomputations can lay 
out various fire-and-smoke induced phenomena which evolve dynamically in time and space 
and can produce multi-sensor stimuli to the firefigjiter in 3D space. (For example, if the 
firefighter stands up, he/she may find his/her visibility reduced due to smoke, whereas if 
he/she crawls, he/she can see more clearly.) 

It has been demonstrated ttiat PC technology is capable of generating virtual worid 
stimuli - in real time. We can flien apply our augmented reality capabilities to the 
development of an augmented reality-based training system. 

ha summaiy, the opportmiity identified above- which has focused on reactions of 
firefighters to fire and smoke in training scenarios - is amenable to augmented reality. 
Opportunities for Augmented Rea Utv for Training, In augmented reality, sensory stimuli 
firom portions of a virtual world are superimposed on sensory stimuli &om the real world. If 
we consider a continuous scale going &om the physical world to completely virtual worlds, 
then hybrid situations are termed augmented reality. 

The position on a reality scale is determined by the ratio of virtual world sensory 
information to real world information. This invention creates a firefighter training solution 
fliat builds on the concept of an augmented physical world, known as augmented reality. 
Ideally, all training should take place in the real world. However, due to such &ctors as cost, 
safety, and environment, we have moved some or all of the hazards of the real world to the 
virtual worid while maintaining the critical training parameters of the real worid, e.g., we are 
superimposing virtual fire and smoke onto the real world. 

For a fire example, consider the following. Suppose an office room fire were to be 
addressed using augmented reality. In this problem, a real room with real furniture is visible 
in real time flirough a head mounted display (HMD) vnth position tracker. Virtual fire and 
smoke due to virtual combustion of office fiuniture can be superimposed on the HMD view 
of the physical office without ever having to actually ignite a piece of real furniture. 

The mventive approach aUows the firefighter to both react and interact with the real 
world components and the virtual components of the augmented reality. Examples of 
potential real-world experiences to be offered by our approach are given below in Table 1-1. 

5 . 
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produced by ac«uUy walkmg or ctawtog « the physical 

experiences. Mitler a 991) divides fire models into two basic 

TT^rlrrrtni T"* ^'^^'^ off Fir > Simulation. Mitler ^1^^^^ ^ ^ ^. 

dlnninistic and stochastic models. Detenninistic models are furflier divided 

"I^r^m oo^-tfve hca. and «ass -ansfer. radiadv. h«. ^ ^ 

"^..^U a. W. on «^ eleven, analysia (.EA, b a zon. n.„da. of a ^ a 
Zonemoaeis«c The conditions within each volume are 

„^ i, divided in.0 a ftw con».l '"'-^--'•^^^^ ^ ^ 

^ ^nn^ app-^noa-e-y^or^t U^^^^^^ 

rs^oT^fltia. and algebraic e<^tion.. Lin..«o„a of zone n^l. rocta^ 

L *o nnmber and location of zones, donb. on «.e vaUdi-y of en.pn.cal 
I^dLhe proceasea »i«n and be^een .ones, and inappHcabiU., of ^ » 
aructuiMWift large a«. or complex inten.alconfigurat.ons. _ „f dna 

F<. nuny training appHc-ions, snch effects arc no, significant for purposes of to 
^.^r^edn^n 1992) p«formed a survey of fire and sn.o,=e nKKlcls. Of 31 models of 
fire. Friedn^nfonnd 21 ..enK^dels and 10 field modela. Most of the .on. 
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models can nin on a PC, while most of the field models require more powerful computational 
resources. 

Background Revie w of Virtual Realitv-B ased Trainin g - and Potential for Augmented 
Realitv-B ased Training . Probably the core issue surrounding the development of any 
training system or program is the efSciency of flie transfer of knowledge and skills back into 
the workplace. Individual development iiltimately rests on the ability to adapt acquired skills 
to novel situations. This is referred to, by some, as a me/o^ifcz//. The transference of skills and 
the building of metaskills are fundamental concepts against which virtual reality must be 
considered for its suitability as a basis for the delivery of training. 

Ejq>eriential learning is based on the premise that people best leam new skills by 
successfully performing tasks requiring those skills. The application of virtual reality to the 
delivery of training builds on the promise of experiential learning to maximize the transfer of 
training mto tihe task environment Furthermore, virtual reality interfeces also hold the 
potential for being more motivating than traditional training delivery media by making the 
training experience itself more fim and mteresting. Augmented reality retains these strengths 
while providing a real world experience for the firefigjiter. 

When concerned with the transfer of skills from a virtual world to flie real world, the 
issue of virtual world fidelity is often raised. Alessi (1988) examined the issue of simulator 
fidelity in both initial learning and transfer of learning and found diat flie impact of simulator 
fidelity increases with the level of expertise of die student He goes on to recommend that 
fidelity increase along lines of instruction phases: presentation, guidance, practice, and 
assessment Alessi's results are corroborated by Lintem et aL (1990) in their woric on the 
transfer of training using flight simulators for initial training of landing skills. Most notably 
the authors found that feedback, related to correct performance of the landing task, resulted in 
increased transfer of training. They also found that transfer of training did not necessarily 
increase widi increasing simulator fidelity. These results on fidelity are important in that they 
emphasize Aat simply creating a task envnonment in a virtual world without consideration of 
learning processes may not be sufficient to transfer skills to the physical world. 

To increase the fidelity of the simulation, a method has been designed to allow a real 
person or movable physical object to occlude virtual objects in an augmented reality 
application using a single tracking data sensor for both human and non-human objects. This 
aspect of the invention comprises an orthogonal plane billboarding technique that allows 
textures with fuzzy edges to be used to convey the sense of a sofl-edged 3D model in the 
space. This is done by creating three orthogonal (perpendicular) planes. A texture map is 
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^ ^ each o, ^ Pla». "f p™«= view, of <be ^^^^ 

Of ^ *=y .00. each of ^ — one -^^^ 
Agonal plane WUboarf U *e modeUng ofatana«he.dandU««.wh^canhe^«. 
occtode fire, water, and smoke into invention. ™.,«™»ch«l1a 
P.rt»rmore,fideU^isincrea»"yP-vidingsuffl<neo.ac»a.«ym..--«-^ 

^„„ge„e.a.evir«a.in.gesand,ni.ton.wi*..»i.na»=a.-*»-J^ 
„„ld can^rainawayd^ttken^sees the virtual and.e.lin-gesnu«an.re...Pn.^ 

I hcad-nunn-ed -acker aUows a cotnpnter .0 synchronize the vir^- 
a..,h.userseesanimasebeing«pda.edc„rr.c..ywifl.hisorhe.he.d. The headphone. 
ft^enhance.hevir«,a1/realexperienceWprovidingapprop.i...anr.I»P»t 

p ^ ..r-r-r- °-»- A de^ption of augn.en.~l ~Wy «as 

IL^ ahove Connnercia. ^ff the she„ technologies eris. wid. which »nnp.en.».. ^- 
Zed reaKty appUcations. «s includes hehnet-nronnted disphrys (HMDs), posr^on 
tacking equipment and liveMitual mixing of hnagety. 

no 1 i. a hU«k dia^ indicating the hardwa^ components of embo<Hmen. of the 
angn.ented.eaU.y(AR)fi..fi<^er.rainingsys«m,also„sef..inth.o.eth^ 
FIG 2 nh^tr^es the geometric particle representation associated w.* smoke. 
FIG 3 iUn^lnrtes the geomethc particle representation associated wr* flamea. 
no 4 iftBtntes the three particle systems used to represent a flie. 

no 5 iltastiates «» idea of two-Uyer smoke obscuration. 

no 6 inustnrtes particle arrangement for a surfcce representation of a particle system. 

nOTinustratesas^racemeshforasurfecerepresentationofaparticlesystem. 

no 8 iUustrates the technotogies that c^nbme «, create an AR firefighter trammg 

system, 

and method. - 

no 9 is a diagram indicating a nozde. extinguishing agent stream, and fire and smote 

nrto is a diagram is . v«i«« of FIG 9 where ti« ^.tingaishmg agent *.am i. 
modeled to have multiple cone layers to represent multiple velocities in tire profile of the 

stre&xn. j 

no 11 is a diagram of the three orthogonal planes that contain the three texture mapped 

images of a human head, useful in understanding the invention. 
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FIG 12 is a diagram of a human head and torso, which will be compared to graphical 
components in FIG 13; and 

FIG 13 is a diagram of two sets of orthogonal planes, along witti the joint between the 
two sets, for &e human head and torso of FIG 12. 

FIG 14 is a diagram of the main components of the HMD integrated with the SCBA. 
FIG 15 is a diagram of a two-mirror layout for placing the camera viewpoint immediately 
in front of the wearer's ^es. 

FIG 16 is a diagram of a headphone attachment design. 

FIG ITisadiagram of a bumper that can be used to protect a mirror. 

FIG 18 is an exploded view of a mirror mount design that places miniTn^ ^m pressure on 

the mirror to minimize distortion due to compression. 

FIG 19 depicts a structure that can be used to protect a mirror fiom being bumped and to 
prevent the mirror mount from being hooked from underneath. 
FIG 20 is a cross-sectional view of the structure of FIG19. 

FIGS 21-23 are top, side, and end views, respectively, of the stmcture in FIGS 19 and 20. 

FIGS 24 and 25 are top and side views, respectively, of a rugged mirror mount 

FIG 26 is a perspective view of a nozzle and all of the major instrumentation components 

involved in the preferred embodiment of the invention, except for the cover; 
FIG 27 is the same as FIG 26, but vnOx flie cover in place; 
FIG 28 is a top view of the fiilly assembled mggedized nozzle of FIG 27; and 
FIG 29 is a front view of the fiilly assembled mggedized nozzle of FIG 27. 
FIG 30 schematically depicts the basic optical and tracking components of the preferred 

embodiment of the invention and one possible arrangement of them. 
FIG 31 shows tfie same components with an overlay of the optical paths and relationships 

to the components. 
FIG 32 is a dimensioned engineering drawing of the prism of FIG 30. 
FIG 33 shows the components of FIG 30 in relation to the SCBA fece mask and 

protective shell. 

FIG 34 shows externally visible components, inchiding the SCBA and protective shell. 
DETAILED DESCRIPTIQN OF THE INVENTION 

FIG 1 is a block diagram indicating the hardware components of the augmented reality 
(AR) firefighter training system, also useful for die me&od of the invention. Imagery from a 
head-wom video camera 4 is mixed in video mixer 3 via a linear luminance key with 
computer-generated (CG) output tiiat has been converted to NTSC using VGA-to-NTSC 
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blended awropriately with the camera tmagery. H» final nnage » «P J 
head-mounted display (HMD) 5. „«A,i™m«on. 

The following subsections explain details relating to in^portant aspects of «ie mvent^on. 
The primary sections are hardware and software. 

HARDWARE wdware to accompUsh the method of the invention. 

This system requires significant hardware lo acc f «„w, opba 

tie nser ta.eAcswi.h.h..ys.«nusinganins«nnen.edand™gged.zed firefighter a SCBA 

Tit Aadi.ienaBy.other«p*m«,.is-*.omix.h.r«andcon,putergene^ 

and run the simulation. 

g m A Tntegra* -"* ^«««« Mounted Display 

^HG wlnmari^ the main e.:,.!.. of the HMD as integrated w,«. ^S«A^ 
i^htding in^ntn-entation re<^ for poking in an AK or VK en—. The ^ 
LnonLs of *. integrated HMD are a video camera 51 a mohon tracker SO, a head- 
^rULT (HM^52. headphones 4». and a self-contained breathing apparan^ 
^I:»r!^ca«;er.snL-«y.e».ps4..oho,d.heSCB.on.o.hewe..»-. 

head. 

^^cien«yligh«ei^«a«.e«nera5>oanh.used,or,hecamer.intheHMD. A 
P^O«XC^(^L»-B..ct.icCorpora.ionof America, or. Pana.^^^^ 
N, 07094) QP-KS162 micro C1ip«icir style) camera with a 7 mm lens (GP-m7TA) ts 
Z^^r^ in the in^nfiot. Bee^ts. d. camera mus. be „om on the user's head. 
CTbeUgh^eighr a.- minimally Obtrusive. The camera's field of view ^OV)mua.^ 
^ .„ thartf HMD for minima, distortion. .... to bes. map the image of the rea^ wo«^ 
«, the ARwoHd; this also contnbutea to ma^ .be user's per^non of P---^ 

AR worn If the HMD is an optical sce-through display, the camem ts no. r qutred. 

Ho^er, Are cu..«- pmfcrred «nbodimen. of the invention is a video.based AK dtsplay. 
• The ideal location of a cam«. for minimal oteet from dre wearer's eyes . msrd. the 

^..seyes. Of course, this is impractical so the optical pad. may be folded u^ mxr^^ 
allow *e camera viewpoint to coincide with the wearer's eye Ic^non wrth the 
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camera at some distance from the wearer's eyes. * Tbese sur&ces can be provided using either 
mirrors or prisms with reflective coatings. In the ruggedized version of the instnunented 
SCBA a prism is the preferred embodiment for image reflection. Using an even number of 
mirrored surfaces as in FIG 15 allows the camera images to be used as-is, and usmg an odd 
number of mirrored sur&ces requires die camera unage to be flipped before it is displayed to 
the wearer of the display. 

Mounting of the nurrored surfaces is a challenge because at least one surface must be 
exposed, yet all suifeces must also be protected. FIG 17 shows a bumper design for 
protecting a minor and whatever this miiror may bump against. FIG 18 shows a mirror 
mount design that both protects a miiror 57 and allows a Tninimfll amount of pressure to be 
applied to this mirror by using a mechanism that sandwiches the minor between parts 58 and 
59, reducingjfae distortion that is created, especially if plastic minors are used. FIGS 19-23 
show an angular frame structure 260 to shield the miiror mount 250 and prevent it from 
getting hooked from underneath. The stnictuze 260 is mounted to flie HMD housing 263 
independent from flie miiror mount 250, and it uses rubber mounts 262 at mounting points 
261. FIGS 24 and 25 show the rugged miiror mount 250 with a raised area 252 at the front 
to prevent tiie mixtor (not shown, but it would be resident at location 251) from getting 
bumped from that direction. The minor mount 250 is mounted vertically through bolt holes 
254, and then a bend 253 at a 45 degree angle is used to place flie minor at the correct 45 
degree relative to flie camera (not shown) which is looking diiectiy down. A hole 255 is cut 
out of the minor mount 250 to reduce weight 

For a stereoscopic embodiment of this aspect of the invention, two cameras are required. 
They should be spaced the same distance apart as flie wearer's eyes and possibly have an 
inteipupillaiy distance (IPD) adjustment. Each camera can be mounted similarly to flie way a 
single camera mount is described above. 
Motion Tracker 

In FIG 14, motion tracking equipment 50 is used to provide real-time, 6 degree of 
freedom (DOF), position and orientation information about a tracked object By attaching a 
motion tracker rigidly to tiie camera, the camera can be tracked. Knowledge of the camera 
field of view and its position and orientation allows a computer to overlay computer- 
generated images on ttie camera video fliat appear to be anchored to locations in S-D space. 
Alternatively, attaching flie tracker to a user's head allows flie user's eye positions to be 
tracked, enabling flie see-flirough embodiment of tfiis technology. Any tracker fliat provides 
suitable 6 DOF measurements can be used as a part of fliis invention. Example technologies 
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f„ i.ven«o„ are «.= OTENSE a«»rS«^ 73 Second ^--"^ 
MA 01803. USA) IS-9«0™ and «.e IKimSENSB (In«Sensc. 73 Second Av«»e, 
Bmlington. MA 01803. USA) IS-600 Maik 2 Plua«. 

ChMD 52. as suted above, can be eiftcr .c-through or non-aee^ ta to 
^T.o.HM^are.oo:a.....«.«.e.nSCBAn^d»P».^"^^ 
lehmem .„ SCB A n^ is » cut ou. par. or all of d» ^nspren, («ewn«) porp of 
rlTu, -.ow .e bu. Of d» HMD .o s« on. wbUe p«n. d. HMD ^»>^» 
a. eyes. Holes driUed fl»o»gh *e n>as. provide attad^en. pon«s «br d» HK^ 

tneMvoaier. j ^„„ „f , he mask, a tteneric solution can be achieved 

By drilling dnon^ to iransparcn' port""" ""^""^^^ 

L do«, no. depend upon d» geometty of any pardcula, SCBA n«>sk or HMD. Tl» 
:^^^ttoLen«onUdreVmTUA.HBSBAKCH(Vir.u-Ke^^ 

*^ , ^ , . o osno^-v V6™ for a non-see-thtough method. (See 

Inc., 3824 Vienna Drive, Aptos . California 95003) Vt. 

FIG 14) 

n:r«n.us.bea«3cbedU.toSCBAifau.oUpar.ofto^appUca.io.-^ 
fbr *e beadphones are *a. *ey should no. block ou. r«.-worM s=^ a^ 
Z should no. ht^fere wi* donning .he n,ask or ^ ''J^ ^ 

^IpM. d^ purposes, a pair of headphones 55 (AIWA [AIWA AMBUCA. INC 
Co.p.LDnveM.hw.h.NI 07430, HP-A09. S^rec Headphones™) r,g,dly»o™^ 54 « 
n^ a. a di^ancc *o. *e wearer-s ears can be used (see FIO 16). Add.«»- 
be add«l .» to shafts 4.. connec. d» headphones « *e SCBA by n««« of 

-in. Which can be accon^liahed .id. IB WBU^ (» Weld Conipany. 
P.O. Box 483, Suipliur Springs, TX 75483). 

AnySCBAn.ask53(FIG14)canbcusedwia.hisinven«on. 
SCOTT (SCO.. Aviation. A Sco« Technologies Company, Erie, lancaster. KY 1408Q 
AV2000~ This mask is «can.p>e of to ^ of to ar. for «reflgh«ng e,.,pmon.. and 
1 design of to n^sk has a bote near to wearer-s nroud. to. allows easy b«adnng =«d 
^wbena,eg„l.*>risnc.«.ached.Whenperforn.ingtoin»grationofd»nw.^^ 
I n..^ ftce seal to "Ccher-s mask" s.yle s^aps for arching to mask, and to nose cup 

are features that are presCTved. 
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When integrating an AR display, it is also necessary to black out any view beyond the 
augmented reality portions of the user's field of view to ensure that the trainee's only view of 
the outside world is die AR view displayed to him/her by the HMD. Jn the case where an 
SCBA is used, the rest of the SCBA can be blacked out by using an opaque substance such as 
tape, foam, plastic, rubber, silicone, paint, or preferably a combination of plastic, silicone, 
and paint This is done to ensure tiiat the trainee doesn't see fbe un-augmented real world by 
using his or her un-augmented peripheral vision to see around AR smoke or other artificial 
(computer-generated virtual) obstacles. 

SCBA Ruggedization 

Since the SCBA is to be used to train for situations in which rough treatment is expected, 
the SCBA must be mg^dized against shock and contaminant penetration. The 
instrumentation that is protected in the instrumented SCBA consists of (1) the head mounted 
display (HMD) used to show an image to the user, (2) the camera used to acquire the image 
the user is looking at; (3) the JhterSense InertiaCube used to measure the SCBA orientation; 
(4) two InterSense SoniDiscs used to measure the SCBA position; and (5) the prism used to 
shift the image in fiont of the user's eyes so that the image is in ftont of the camera. All of 
ttiis equipment, except for the prism, has electrical ccmnections that carry signals tiuough a 
tether to a computer, which receives and processes these signals. 
Layout of Components for Ruggedization 

In FIG 30, the eye 137 of the person wearing the SCBA (not shown) looks through the 
optics 138 to see-flie image formed on the display element inside the electronics portion 139 
of the HMD. Separately, the unage of the outside worid is captured by camera 135, which 
looks through a prism 140 that has two reflective sur&ces to bend the path of Ught to the 
camera 135. The trackiug components, in this case fixun InterSense, include the InertiaCube 
136 and two SoniDiscs 141 which are positioned on either side of the camera, one going into 
the figure, and one commg out of the figure. The InertiaCube 136 can be placed anywhere 
there is room on the structure, but the SoniDiscs 141 must be at the top of the structure in 
order to have access to the external tracking components. 

FIG 31 shows detailed sketches of the light paths. Upon entering the prism 150 at the 
polished transparent entrance pomt 153, the FOV 151 of the camera 155 is temporarily 
reduced due to the refiactive index of the glass, preferably SFL6 as it has a very high index of 
refiaction while maintaining a relatively low density. This reduced FOV 151 is reflected first 
off mirrored surfece 152 and dien mirrored surface 148 before exiting through surface 149. 
Upon exit, the FOV 151 is restored to its original size, and any aberrations due to the glass is 
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eliminated since ±o FOV 151 is entering and exiting the prism perpendicular to surfeces 153 
and 149 Using this layout, the image captured by the camera 155 is effectively taken ftom 
the virtual eye-point 147. even though the real eye-point of ^ camera is at pomt 154. 

m HG 31 the virtual eye-point 147 would ideally be at the same point as the user's eye- 
pointl44. To make this happen, however, the optics wouldhave to be bigger. It is preferred 
to use smaller optics that place the virtual eye-point 147 sUghtly forward of the user's eye- 
point 144. Tins arrangement tends to be acceptable to most users. Even fliough the vntual 
eye-point 147 isn't lined up exactly with the eye 144. the HMD (146 and 145) as well as the 
prism 150 are all co-located on the same optical axis 143. thereby minimizing d« 

disorientation of the user. 

TO achieve the same eye-point 147 without the use of the prism or mirrors would require 

placing the-camera at the same location as the user's eye 144 as weU as HMD 146 and 145. 

By folding the light path with the prism, the camera 155 can be placed above the other 

components, thereby achieving a relatively compact solution. 

FIG 32 shows Ae detailed dimensions and descriptions of the preferred prism. Surfeces 

157 and 159 are mirrored and surfaces 160 and 158 are polished. All other surfeces are plam 

or preferably painted black. All units in the drawing are inches. TTie prism can be mounted 

to the SCBA by fixing mounting plates that define tapped holes on the two sides of the pnsm. 

The prism material is preferably SFL 6. which has a refractive index of 1 .8. 

If two mirrors are used instead of the prism, then the utiUty of producing a right-side-up 

ixnage is accompUshed because of the two reflections. However, if the FOV 151 of Ae 

camera 155 is relatively large, then the mirrors required to fold over the FOV 151 would have 

to very large in order to clear the case of the camera 155. 

An alternate solution to the use of the prism is to place the camera 155 looking straight 
down using one mirror. So long as the image from the camera 155 can be processed with 
video equipment to mirror back the image it would woric. but it will most likely either place 
the camera 155 in an mconvenient location, or the mirror would have to be very large. 

If mirrors are used, there are several choices for materials. The lightest and cheapest are 
plastic mirrors. A step up in quality would be the use of glass mirrors, especially if they are 
ftont-surfece mirrors (versus the typical back-surfeced mirrors used in households). The 
highest durabiUty and quality can be achieved with metallic mirrors. Metallic mirrors, 
preferably aluminmn. can be manufectured that have tough, highly inflective surfaces. Metal 
mirrors can be made to have built-in mounting points as well, enabling a mirror very well 
suited for the needs of the invention for light weight, compact size, and durability. 
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The veiy simplest alteniative metbod of camera anangement would be to put fhe camera 
parallel to and directly above the optical axis of HMD 146 and 145. This method negates flie 
need for a prism or mirrors, but it loses all of the benefit of Ae virtual eye-point on the optical 
axis of the HMD 146 and 145. 

Equipment Mounting and Connections 

The HMD 170 (FIGS 33 and 34) is mounted directly to the SCBA 174. Ihe InertiaCube 
167 (FIG 34) and SoniDiscs 179 are attached rigidty to ±e camera 168 /prism 171 assembly 
(or mirrors if diose are used), locking their positions toge&er. By locking the position 
tracking equipment directly to the camaa/prism assonbty, one can ensure that ibs conq)uter- 
generated imageiy will conespond to the camera's position. A hard plastic electronics 
enclosure or sheU 170 (HG 33) attaches to the SCBA 174 preferably wifli bolts 173, 
providing a means for hiding fi»m view and protecting fi»m die elements all electronic 
equipment, except for the SoniDisc speakers 169, which must be exposed to flie air to allow 
the separate tracking devices (not shown) to receive the ultrasonic chirps coming fiom the 
SoniDiscs. The plastic shell 170 that surrounds all of die equipment should be made of a 
tough material, such as nylon, that can withstand the shock of being dropped, yet is sli^tfy 
bendable, aUowing for a little bit of inherent shock-mounting for die equipment If this is not 
sufficient, then the HMD 176, prism 171, camera 168, and/or tracking equipment 167 and 
7 7P can be mounted to Ifae SCBA 174 and plastic sheU 170 witii rubber mounting points (not 
shown). In Uiis case Ihe HMD, prism, camera, and/or tracking equqmient can aU be mounted 
together with a very rigid structure, for example a metallic fiame (not shown). That rigid 
structure could then be mounted separately to the plastic shell, preferably with shock- 
absoibing mounts. 

The signal wires (not shown) coming fiom die instrumentation 168, 176, 167, and 179 
come out of die plastic shell 170 tiirough a single hole 166 witii built-in strain relieL^suting 
that die cables cannot be pulled out of die plastic sheU 170 flm>ugh normal use, and also 
ensuring diat pulling on the cables will not create unacceptable cable wear. To maximize 
ease of use and maintenance, die cables coming out of die plastic shell can be attached to a 
single, specialized connector eidier mounted on die plastic cover at die exit point 166, or 
preferably attached to die belt of die wearer. From ttiat connector, anodier single cable 
connects diis one connector to die computer (not shown) and odier equipment (not shown) by 
splitting die cable into its sub-connectore as needed by die various components. The use of 
fliis specialized connector provides for easy connect and disconnect of die equipment from 
the user. 
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Equipment Shock and Contamination Protection 

T^e equipment is protected by a plastic cover which protects Ihe overaH ^^J^^ 
hothshoollpenetrationhyforei^agents,suchaswateranddi. ^^^^^ 
SoniDiscsaresomewhateasytouncaUbrateanda^sensitivetoshocl. ms provides a great 

deal of shock protection. . ^x^^ 

on. p<«,tia. is^ wift HMD 176 U me W.d-.p of beat. .3 HMD g.,^ off a 
^ one „^ is » put vent holes (no. ^w.) ft. pta^ co- m 
^ access . coo, ou«ide ft. cover 17.. bow«« 

The prcfened o«ftod is U> have oo.-»ay vaives 17a 18. '^^^ 
^,74. Inftisp«f««dm«hod..sfteus.rbreaftes,nair.fte«rcom«>«ft™.ghft. 

^.ft ^ as is normal, hut ft«. fte air ^ redirected by a one-w valve 175. »p ftro^ 
a on..v«y valv. 172 .«l ft>is inU. shell 17., ften over ft. electtomos. a»i .»ay ft™*e 
.l«*onk. ftrough ^ one-way valve 180 before entering ft. us^'s airway. When 
„^ ft. nKna.. wann air would get a direct paft to fte outside via ft. one-way valve 
175. ■nns.«itaotionofaircanbep«=fcrablyaccompUsh.dftro«ghfteuseoft5^caI,one- 

way rubber valves. 

Protection Against Misuse 

TO prevent the user ftom accidentally usiBg the device in a real fire emergency, the 
protective designusesanobvious indicator to the user thatthe device is for training 

and not for use in real emergencies. T^. preferred method uses an alternating yeUow and 
blackcolorschemetogetthe user's attention thatthis is notastandardpart. Additionally, a 

sign is used which indicates that the device is to be used for training purposes only. 

TnRtrmnent ed Nozzle 4^ ^ 

Additional harfware is att«=hed to a flr.fight«-s vad-nozzle 193 to aUow control of a 
virtu., wa.« s.r«nn. The nozd. usrf is aiftart vari-nozde. The tosmonentation f^ fte 
nozzle consists of (,) a po,»tiome.« us«l to measure fte nozzle fog patton; (2) a 
potentioo».er used to measure ft. nozzl. hail angle; (3) an INTEESENSE (Bnrling«>n. MA) 
LtiaCube u.«l to m^sute ^ «^ ^ >NTBRSENSE (Bmhngton. 

MA) SoniDiscs ^ to m«sur. the nozzle position. All of ftis equipment is competed by 
firing ftat carries message ^ ftrough a tefter to a computer and associated equipment 
(inCuding an m.a,.g-.o^gita, «mv«ter) which receives and ptoce^ ftese signals. The 
toertiaCah. and SoniDi»:s «. equipment ftom fte to.erS«^ IS-600 line of trackmg 
eqmpment tf,he«rf user offtenozdocaUs for ft. naeottracldng equipment ofterftan fte 
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IS-600 line, the invention could readily be adapted to protect equipment from the IS-900 line 
from LiterSense, and 3rd Tech's optical tracking equipment 

Instrumented Nozzle Ruggedization 

All of the described nozzle instrumentation is protected from shock and contaminant 
intrusion by a shell an island design. This shell and island, described below, would need to 
be modified slightly to hold different tracking equq)ment in place. 

Equipment Mounting and Connections 

In FIG 26, at least two potentiometeis (not visible, but with one under potentiometer 
cover 187 to measure the position of bail 184 and one within the pattern selector 192 to 
measure its position) are mounted direct to the vari-nozzle 193. The MertiaCube 194 and 
SoniDiscs 183 are attached to a rigid, yet floating hard plastic island 181 which holds these 
items firmly m place. This island 181 is attached to a rigid hard plastic base 190 by two 
narrow, flexible posts 189. The base 190 is rigidly attached to the nozzle. A hard plastic 
cover 198 (FIG 27) attaches to the base 190, providing a means for hiding all electronic 
equipment from view, except for the speakers 182 (FIG 27) on top of the SoniDiscs 183, 
which must be exposed. This cover 198 (FIG 27) also constrains the floating island 181 from 
finely drifting laterally on the very flexible posts 189. The potentiometer undemeaA the 
plate 187, which measures the angle of the bail 184, is attached to the nozzle 193 by a soft 
polymeric coiq)ling 185. The signal wires coming &om certain instrumentation are attached 
to the mounting block 195 using screw-down connectors or soldering posts 186 integrated 
inside of the cover. The purpose of using Ms sort of connection is that the wires can be held 
much more securely with this method rather tfian standard plugs. By using solder or strong 
screw-down terminals, flie wire connections can be assured a quality connection. A separate 
cable (not shown) connects this common mounting block 195 to the computer and associated 
equipment which receives data from the nozzle. The specific wires that can be easily 
mounted in this way include (a) the leads from the SoniDiscs 183, and (b) the wires attached 
to the leads 188 of the potentiometer under the plate 187 and the potentiometer inside the 
pattern selector 192. The cable connection to the InertiaCube 194 may not be suitable to 
separately wire in this &shion since the InertiaCube signals may be sensitive to interference 
due to shieldmg concerns, though it should be possible to use a connector provided from 
InterSense. The wires and/or cables are routed through a hole in the nozzle (not shown), and 
down the hose (not shown) to tiie end where fhey can come out and connect to the needed 
equipment This method keeps the wires from being visible to the user. 
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Equipment Shock and Contaminatton Protection 

^ nt is protected by a plastic cover 198. which ptotecte the overall assembly 

The equipment is protectea oy a pioaut 

ft„,„ Shoe, and peoe^aHon by fo^ig. ^ » wa« ^^"^ 

™ baU In. 184. M«iBg *= ^ ^ « °* x.^ of mono. 

I ^lacub. and SoniDiso. a„ n.o».cd on an island wbich i, hcM np by «.o »a 

(no, sb„». in d.e Sg„-) locked b«w«n *= is.«- »« and *. c^»- 

Ucmei3,a„d*>n.hori«»...shoc.. d^ layer aiso p««idaa te«»r P^^*- 
Ue««» f<«e*- a.o«, and can be n^ sncb d.. .c». se^ » »^ 
^Li^ of d„ island. A-llsboen^ofs„«n.»nal.naedasab^91^ 
p^on. shock caused by sening d.e device down .00 ..pidnr or dnw»g * *- 
^„ear«sis.ance.d.ebaaepar.ind.asse™bly. T1„ sboe i, also a visual cne » *e 
nser ftt*e device is to be se, down using fl» shoe as a contact poml 

Protection Against Misuse 

TO prevent the user flom accidentally using the device « spn.y water as m a real fi« 
emerged .he protecdve design uses an alten^ting yeUow ^ black color schetn. 
ZTu. Juser-s attendon that this is no. a standard part Addi.^. a srgn s^hed 
rr co.^ shown) i. used which indicates a., d. device is » be u«d for .rannng 

purposes only> 

A UAi^ate Har -'"'"-'' 1? mhodiments , „«^ti,«.nrf, 

one .«em«ive.o,he display setup dUgr^nnted in FIQ 1 is d» use of ophcal see^ 
such an onhodin^u. can^ra 4 and video .nixer 3 are absent and HMD 5 on^^ 

Xwait. wearer to seecon^uter graphics ovcr«onhis.er direct View Of 

embodiment i. no. currendy P^ferred for fire fighdng because current se^d=o«gh 
,eohnologydoesnotdlowblacksmokc,oobscuieaviewefsv,s.on. 

A slui aMernative to dte display seurp diagramn^d in no 1 .a capturu^ ™l 

claying .he camera video signal in U» computer, which removes the video rmxer 3 Sum 
L s^ dUgmn. This allows high-<,uaU.y imagery to be produced because d» alpha. « 
„,,3p.^ ch»mel of*, computer X graphics system may be used to specrfir ^ 
of biding b.tw«n camera and CO imagery. This embodiment is no. current^ P^fe^d 
Lus. d^ type of image blending described here re.^ additional delay of d« vdeo 
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signal over the embodiment of FIG 1, which is undesirable in a fire fighting application 
because it reduces the level of responsiveness and interactivity of the system. 

A third alternative to the display setup diagrammed in FIG 1 is producing two CG images 
and using one as an external key for luminance keying in a video mixer. In this embodiment, 
two VGA-to-NTSC encoders 2 are used to create two separate video signals from two 
separate windows created on the computer 1. One window is an RGB image of the scene, 
and a second window is a grayscale unage representing the alpha channel. The RGB image 
may be keyed with the camera image using the grayscale alpha signal as die keying image. 
Such an embodiment allows controllable transparency with a mimnnmi of real-world video 
delay. 

FIG 1 diagrams the two 6 degree-of-fi:eedom (6DOF) tracking stations 7 and 8 present in 
all embodiments of the system. One tracking station 7 is attached to flie HMD 5 and is used 
to measure a user's eye location and orientation in order to align the CG scene with the real 
world. In addition to matching ttie real-world and CG eye locations, the fields of view must 
be matched for proper registration. The second tracking station 8 measures the location and 
orientation of a nozzle 9 fliat may be used to apply virtual extinguishing agents. Prediction of 
the 6DOF locations of 7 and 8 is done to account for system delays and allow correct 
alignment of real and virtual imagery. The amount of prediction is varied to allow for a 
varying CG frame rate. The system uses an InterSense IS-600 tracking system 6, and it also 
supports the LiterSense IS-900 and Ascension Flock of Birds. 
SOFTWARE 

A method for real-time depiction of fire is diagrammed in FIGS 2-4. A particle system is 
employed for each of the persistent flame, intermittent flame, and buoyant plume components 
of a fire, as diagrammed in FIG 4. The particles representing persistent and intermittent 
flames are created graphically as depicted in FIG 3, Four triangles make up a fire particle, 
wifli transparent vertices 12-15 at the edges and an opaque vertex 16 in the center. Smooth 
shading of the triangles interpolates vertex colors over the triangle sur&ces. The local Y axis 
27 of a fire particle is aligned to the direction of particle velocity, and the particle is rotated 
about the local Y axis 27 to fece die viewer, a technique known as 'TjiUboarding/* A fire 
texture map is projected through botii the persistent and intermittent flame particle systems 
and rotated about a vertical axis to give a horizontal swirling effect. 

Smoke particles, used to represent the buoyant plume portion of a flame, are created 
graphicaUy as depicted in FIG 2. A texture map 11 representingapufifof smoke is applied to 
each particle 10, which consists of two triangles, and transparency of flie texture-mapped 
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partiote ma^s ^ app.aranc= of polygon =ag^ S»ol» pa«icl« 10 «. »UW abo« »o 
axes te face the viewer, a tecl>ni<p» bK«™ as "spterical billboMdfflg." 

The aame base 17 is us«» as fl» p»<icle for a«» P««cU, systen^. aM 

buoyancy and drag forces are appUed tt, each system U> »=Ueve acceleration in to 
flame. near-c„ns«n. velocity in *. intemri«en. fl»ne. and deceleration in the b».y». 
ptoe. An extenial force represe^ing wind or ven. flow n»y also be appUed to affect the 
bebaviorofthefireplmneparticles. When flan» particles are bo* they are given, veloctt, 
directed ^.wards the center of to fire and a life span inv«se^r proportional to then nntua 

distance ftom to flame center. The emission rat. of hnetmitien. flame particles flu«n«e. 
sinusoidally at a rnte detennined by a correlation ^.h to flam, base Fhm. height m«r 
be controU^l by appn^tiately specifying to Bfe .pan of petioles h. to een.« portion of to 

flame. i- a 

A number of graphical features contribute to flie reaKstic appearance of the fire and 
smoke plume diagrammed in TIG 4. Depth bu^ writing is disabled when drawing fte 
particles to allow blending without the need to order the drawing of &e particles ftombackto 
ftont A Ught source is placed in the center of tiie flames, and its brightness fluctuates m 
unison with the emission rate of the intermittent flame particle system. Tb. Ught color « 
based on the average color of the pixels in the fire texture map appUed to *e flame particles. 
Lighting is disabled when drawing the flame particles to allow ti«m to be at Ml brightiH«s, 
and Ughting is enabled when drawing the smoke particles to allow the Ught source at the 
center of Ihe flame to cast Ught on the smoke plume. A billboarded. texture-mapped, polygon 
with a texture that is a round shape fading from bright white in the center to transparent at 4e 
edges is placed in the center of the flame to simulate a glow. TTie RGB color of the polygon 
is the same as the Ught source, and the alpha of the polygon is proportional to the density of 
smoke in the atinosphere. When smoke is dense, the glow polygon masks ^ individual 
particles, making the flames appear as a flickering glow tim>ugh smoke. THe glow width and 
height is scaled accordingly witii the flame dimensions. 

no 5 describes the concept of two layers of smoke in a compartment In a compartment 
fee smoke from the buoyant plmne rises to the top of a room and spreads out into a layer, 
creating an upper layer 20 and a lower layer 21 with unique optical densities. THe lower 
layer has optical density k„ and the upper layer has density Transmittance through the 
layers from a point P 19 on tixe waU to a viewer's eye 18 is given by the equation 
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T = e-<*rt**A) The color of 19 as seen ^ugh smolre is given by C = TC,+(X- T)C, , 
where d represents the color of 19 wilh no obscuration and C, represents the smoke color. 

To apply the concept of two-layer smp^ in an AR system, a polygonal model of the real 
room and contraits is created. The model is aligned to die corresponding real-world using the 
system of FIG 1. As die model is drawn, the above equations are applied to modify die 
vertex colors to reflect smote obscuration. Smoodi shading interpolates between vertex 
colors so that per-pixel smoke calculations are not required. If die initial color, C„ of die 
vertices is white, and die smoke color, C„ is black, the correct amount of obscuration of die 
real world will be achieved using the luminance keying mediod described above. In die odier 
video-based embodiments, die above equations can be applied to the alpha value of vertices 
of the room model. 

In computer graphics, color values are generally specified using and integer range of 0 to 
255 or a floating point range of 0 to 1.0. Using die obscuration approach described above of 
white objects fliat become obscured by black smoke, diis color specification does not take 
into account light sources such as windows to flie outdoors, overhead fluorescent lights, or 
flames; which will shine dirough smoke more than non-luminous objects such as walls and 
furniture. To account for diis, a luminance component was added to die color specification to 
affect how objects are seen dirou^ smoke. Luminance values, L, range ficom 0 to 1.0 in diis 
embodiment, and diey alter die efifective optical density as foUows: k*= ki\ - L) . This makes 
objects widi higher luminance show flnrou^ smoke more than non-luminous (L=0) objects. 

One additional component to die layered smoke model is die addition of a smoke particle 
system, as depicted in HG 2. A smoke particle system is placed in die upper, denser layer 20 
to give movement to die odierwise static obscuration model. To determine die volume and 
optical density of die upper smoke layer, one mediod is to assign volume and density 
characteristics to tiie buoyant plume smoke particles. When a buoyant plume smoke particle 
fades after hitting die ceiling of a room, die volume and optical density of die particle can be 
added to die upper layer to change die height and optical density die layer. 

The same polygonal model used for smoke obscuration is also used to allow real-world 
elements to occlude die view of virtaal objects such as smoke and fire. A fire plume behind a 
real desk diat has been modeled is occluded by die polygonal model. In die combined AR 
view, it appears as if die real desk is occluding the view of the fire plume. 

Graphical elements such as flame height, smoke layer height, upper layer optical density, 
and lower layer optical density may be given a basis in physics by aUowing diem to be 
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controUed by a zone fire model. A file teader developed for the system aUows CFAST 
models to control the simulation. CFAST. or consoUdated fire and smoke transport, is a zone 
.odel developed by the National InstHule of Standards and Technology (^^^ 
worldwide for compartment fire modeling. Upper layer temperature calculated by CFAST is 
monitored by the simulation to predict the occurrence of fla^ver. or Ml room involvement 
in a fire. The word "flashover" is displayed toa trainee andlhescreenis turned redto 
indicate that this dangerous event in the development of a fire has occurred. 

A key component in a fire fighting simulation is simulated behavior and appearance of an 
extmguishing agent. In this embodiment, water application ftom a vari-nozzle 9. 23. and 25 
has been simulated using a particle system To convincingly represent a water stream ^ 
computation, a surface representation of a particle system was devised. Ihis 
representation allows very few particles to represent a water stream. as opposed to alternative 
methods that would require the entire volume of waterto be fined with particles. Behavior 

such as initial water particle velocity and hose stream range for different nozzle settings is 
assigned to a water particle system Water particles are then constrained to emit m a rmg 
pattern from the nozzle location each time the system is updated. This creates a series of 
rings of particles 22 as seen FIG 6. The regular emission pattern and spacing of particles 
allows a polygon surface to easily be created using the particles as triangle vertices, as seen m 
the wireframe mesh 24 in FIG 7. The surface 24 is texture-mapped with a water texture, and 
the texture map is translated in the direction of flow at the speed of 4e flow. A second 
surface particle system that is wider than the first is given a more transparent texture map to 
the hard edge of the surface particle system representation. A third particle system usmg 
small billboards to represent water droplets is employed to simulate water splashing. 

To add realism to the behavior of the water stream. coUision detection wifli die polygomd 
room and contents model is employed. A ray is created from a particle's current position and 
its previous position, and the ray is tested for intersection with room polygons to detect 
collisions. When a collision between a water particle and room polygon is detected, the 
particle's velocity component nomial to the surface is reversed and scaled accordmg to an 
elasticity coefficient The same coUision method is applied to smoke particles when they 
coUide with the ceiling of a room. Detection of collision may be accomplished in a number 
of ways, me "brute force" approach involves testing every particle against every polygon. 
For faster collision detection, a space partitioning scheme may be appUed to the room 
polygons in a preprocessing stage to divide the room into smaller units. Particles within a 
given space are only tested for collision widi polygons that are determined to be in that space 
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in the preprocessing stage. Some space partitioning schemes include creation of a uniform 3- 
D grid, binary space partitioning (BSP), and octree space partitioning (OSP). 

A simpler approach to coUisions that is applicable in an empty rectangular room is fbs use 
of an axis-aligned bounding box. In such an implementation, particles are simply given 
minimum and maximum X, Y, and Z coordinates, and a collision is registered if the particle 
position meets or exceeds the specified boundaries. 

To increase the realism of water application, steam is generated when water particles 
coDide at or near the location of the fire. Steam particle emitters are placed at the collision 
locations and they are given an enuttance rate that is scaled by the size of the fire and the 
inverse of the collision's distance &6m the fire. Steam particles are rendered as spherically 
billboarded, texture-mapped polygons similar to the smoke particles in FIG 2, but with a 
different texture map 11 and difierent particle behavior. In compartment fire fighting, steam 
is generated when a hose stream is aimed at the upper, hot gas layer. Steam particle systems 
may be placed in this layer to simulate this phenomenon. Steam emittance in the upper layer 
can be directly proportional to the temperature of the upper layer as calculated by CFAST. 

To simulate extinguishment, a number of techniques are employed. Water particles that 
collide with the sur&ce on which the flame base is located are stored as particles that can 
potentially contribute to extinguishment The average age of fliese particles is used in 
conjunction with the nozzle angle to determine the average water density for the 
extinguishmg particles. Triangles are created usmg the particle locations as vertices. If a 
triangle is determmed to be on top of the fire, then an extinguishment algorithm is applied to 
the fire. 

Extinguishing a fire primarily involves reducing and increasmg the flame height in a 
realistic manner. This is accomplished by managing three counters that are given initial 
values representing extinguish time, soak time, and reflash time. If mtersection between 
water stream and flame base is detected, the extinguish time counter is decremented, and the 
flame height is proportionately decreased until both reach zero. If water is removed before 
the counter reaches zero, the counter is incremented until it reaches its initial value, which 
increments Ihe flame height back to its original value. After flame height reaches zero, 
continued application of water decrements the soak counter untU it reaches zero. If water is' 
removed before the soak counter reaches zero, the reflash counter decrements to zero and the 
flames re-ignite and grow to their original height The rate at which the extinguish and soak 
counters are decremented can be scaled by the average water density for more realistic 
behavior. 
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To allow more reaUstic extinguishmg behavior, a flame base is divided into a 2-0 grid of 
smaUer areas. Each grid square is an emitter for toee particle systems: persistent flames, 
intermittent flames, and buoyant plmne. When flame particles are bom in a grid square, they 
are given a velocity directed towards the center of the flame base and a life span mversely 
proportional to their initial distance ftom the flame center. This allows multiple flame 
particle systems to appear as a smgle fire. Each grid square has an independent flame height, 
extinguish counter, soak com»ter. and reflash counter. This allows portions of a flame to be 
extinguished while other portions contimie to bum. This is especially useful for larger fires 
where the hose stream can only be directed at one part of flie fire at a time. 

To further enhance the realism of the shnulation. computation of approximate forces from 
the agent stream on airborne particles is also performed. HG 9 represents the preferred 
embodiment of a real-time graphical simulation of an extinguishing agent 29 (eg., wat€r or 
foam) exiting a nozzle 28 in the vicinity of a fire and smoke plume 30. If the extinguishing 
agent, fire, and smoke plume are modeled as particle systems, each extinguishing agent, fire, 
or smoke particle will have a mass and a velocity associated with it Using a scale fiictor 
based on distance, a force on the fire and smoke particles can be calculated fiom the speed 
and direction of extinguishing agent particles. To model tiie effect, an equation of the form 
(other actual forms are envisioned, but tiiey will mainly show similar characteristics): 

can be made, where: 

PV<«t is the velocity (3-D vector) of the smoke and fire particles after the force is applied 
PVin is tiie velocity (3-D vector) of the smoke and fire particles before the force is appUed 
ExtAV is the velocity (3-D vector) of extinguishing agent particles 
R is the radial distance between the smoke and fire particles and the extinguishmg agent 
particles 

K is a fector that can be adjusted (firom a nominal value of 1) for. 

- Destied ftiction of the particle interactions 

- The time m between simulation updates (will be referred to as At) 

- Mass of the smoke, fire, and extinguishing agent particles 

- Or other particular simulation characteristics where a value of 1 produces unrealistic 
results 

A force on the fire and smoke particles can be calculated based on the change in velocity: 
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where: 

F is the actual force (3-D vector) to be applied to flie smoke and fire particles 
Mass is the mass of the fire or smoke particles 
At is the time in between simulation updates 

Taking the above two equations, substituting and simplifying, tiie equation for the 
calculated force could be: 

,ExtAV-PVr V 

( r—r-^)*K*Mass 

F = i±K 

A/ 

Other versions of this equation are envisioned, but they are expected to be of a similar 
nature, with die same iapats as this equation. 

The application of the calculated force simulates the visual effect of the e^ng tiichi^g 
agent stream causing auflow tiiat alteis the motion of fire and smoke particles. Additionally, 
the calculations can be applied to smoke or other particles that are not part of a fire and 
smoke plume, such as extinguishmg agent passmg through ambient steam or ambient smoke 
particles m a room. Tte invention extends to otiier aerosols, gases, and particulate matter, 
such as dust, chemical smoke, and fumes. 

As shown inFIG 10. a side view of the preferred embodiment, a fiirther refinement for 
determining a force to apply to particles in tfie fire and smoke plmne 35 would entail 
modeling extinguishing agent 32-34 in cones 32, 33, and 34 (which are afected by gravity 
and wiU droop) fiom flie nozzle 31. where the multq,le additional concentric cones 32 and 33 
to apply varying force. ^ One embodiment that can produce the cones 32. 33. and 34 can be a 
system of rings (tiie system of rings may be modeled as a particle system) emitted from the 
nozzle, which, when connected, form cones 32. 33, and 34. TTiose fire and smoke particles 
35 which are contained mosfly mside the inner cone 34 of die extinguishing agent 32-34 can 
have one level of force appUed, and fire and smoke particles 35 which are not contained 
witinn cone 34. but are contained within cones 33 or 32 can have a different, often smaller 
force applied to them. TTius. multiple levels of velocity fiom extinguishing agent and ai^ 
entrainment can be easily simulated to apply multiple levels of force to the fire and smoke 
Ihe additional cones 33 and 32 (or more if additional levels of force are desired) do not have 
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to be dra^ in the simulation, as they could be used strictly in detennining Ihe force to apply 
to the fire and smoke. 

In the case of modeling the extinguishing agent as concentric cones outlined above, fte 
force applied to a particle can be modeled as: (A) the extinguishing agent cone(s) 32. 33. 34 
each having a velocity associated with them. (B) a difference in velocity between a particle 
35 and the extinguishing agent cone(s) 32. 33. 34 can be calculated. (C) a force can be 
calculated that scales with that difference, and (D) the particles 35 will accelerate based on 
the force calculated, approaching the velocity of flie extinguishing agent inside of the cone(s) 
32 33 34. 

' The results of the simulated effects described above can be observed by drawing particles 
as computer-generated graphics primitives using real-time graphics software and hardware, 
nie invention is appUcable to such areas as training simulations and computer games. 

To enhance the augmented experience, a technique has been implemented to occlude fte 
computer-generated elements, such as fire, water, and smoke when a desired object (such as a 
second user) is standing in the path of Ihe user's viewpoint to the computer generated 
elements, m the invention, texture maps representing the movable object (such as another 
user) are mapped onto three orthogonal planes. A tracking sensor is used to determine the 
actual position and orientation of the object, as appropriate. When the viewer's viewpoint is 
perpendicular to a plane, the texture map is opaque. When the viewpoint is parallel to the 
plane, the texture map is transparent. The texture map is feded between fliese two extremes 
as the orientation changes between these two extremes, to accomplish a desiiable graphical 
mixing resuh that matches tiie silhouette of the object (or human) while maintaining a softer 
border aromid the edge of the silhouette contamed in tiie texture map. The appearance of a 
soft ("fuzzy") border is made by fading to transparent the edges of the object silhouette in the 
texture map. 

In the preferred embodiment, as shown in FIG 11, a series of three texture maps 
contaming silhouettes 36, 42. and 37 (in this case of a human head, from the side. top. and 
front, respectively) are shown mapped onto each of three orthogonal planes 38. 40 and 41, 
respectively. Ihe texture maps may fade to transparent at their edges for a fuzzy appearance 
to the shape. The orthogonal planes are each broken up into 4 quadrants defined by tiie 
intersection of the planes, and the 41 resulting quadrants are rendered from back to fix>nt for 
correct alpha blending in OpenGL of the texture maps and planes, with depth buffering 
enabled. When a plane is perpendicular to the view plane of a virtual viewpoint looking at 
the object, the plane is rendered to be completely transparent A Unear fade is used to 
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completely fade the texture map to completely opaque when the plane is parallel to the view 
plane. ITiis fade from opaque to transparent as flie planes aie turned relative to a viewer is 
responsible for the large part of the desirable fuzzy appearance to the shape. The texture 
maps used to shade the three planes were created from a digital image of a person, (hen made 
into grayscale silhouettes, and so match the silhouette of a human user very well. The edges 
39 of the human silhouettes in the texture maps were bluned so that diey would &de linearly 
from solid white (which represents the silhouette) to soKd black (which represents non- 
silhouette portions of the texture map) to look better in an augmented reality situation where 
a Uttle bit of a fuzzy edge is desirable. This fuzzy edge spans what is equivalent^ 
approximately 0.5 inches in real distance. 

FIG 12 depicts a diagram of a human 44 wearing a head tracker 43 on a head mounted 
display, nie virtual representation of human 44 is shown used in the inventive technique in 
FIG 13. Item 43 in FIG 12 is a motion tracker, in this case a six^egree-of-fieedom motion 
tracker that measures the head location and orientation. TTie position and orientation 
information from tracker 43 can be applied to orthogonal plane billboards. 

If the object being depicted has a pivot point, such as pivot point 46 in FIG 13 for a 
human neck-torso joint, an orthogonal plane billboard torso 47 can be created m 
approximately the correct place relative to the joint The torso in this instance may be 
designed to remain upright, only rotating about a vertical axis. The head in this instance has 
foil 6 degree-of-freedom motion capability based on Ae data coming from tiie tracker worn 
on the head of the user. This aUows the head orthogonal plane billboard to be lined up 
correspondingly with the user's head. The torso orthogonal plane biUboard is attached to the 
pivot point 46 and is placed "hanging" straight down from that point, and has 4 degrees of 
freedom: three to control its position in space, and one controlling the horizontal orientation. 

The head and torso models, when lined up to a real hmnan. occlude compute r-generat ed 
graphics in a scene. If augmented reality video mixing is achieved with a luminance key to 
combine Uve and virtual images, white head and torso models will mask out a portion of a 
computer-generated image for replacement with a live video image of the real world. Hiis 
invention can be applied to any real world movable obaects for which an occlusion model 
may be needed. 

The above technique is also applicable to a movable non-person real world object. If the 
non-person object has no joints, then such an implementation is simpler since the complexity 
of coupling the separate head and torso models is avoided. The technique for the single 
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movable leal-world physical object is functionally identical to ^ above meflu)d when only 

the head model is used. 

3-D audio allows sound volume to diminish with distance ftom a sound emitter, and it 
allow works with stereo headphones to give directionaUly to sounds. 3-D audio emitters are 
attached to the fire and the hose nozzle. The fire sound volume is proportional to physical 
volume of the fire. 

Appendix A contains settmgs for the parameters of particle systems used in Ae mvention. 
Those parameters are meant to be guidelines lhat give realistic behavior for die particles. 
Many of the parameters are changed withm die program, but die preferred starting parameters 
for flames, smoke, steam, and water are Ksted m the appendix. 

Appfn«oh to U,.*^fU.r.d ARBT fnr Firefighters. The basic philosophy behind die 
objectives herein for developing an untefl«red ARBT system for firefighters follows firom a 
systems-based approach to training system development The essential steps in such an 

approach are: 

• Detemiine traming goals and fimctioiis 

— Implement a development strategy 

• Perform traming needs analysis 

— Assess training needs 

— Collect and analyze task data 

• Undertake training system development 

— Write training objectives 

— Construct criterion measures 

— Constmct evaluative measures 

— Choose a delivery system 

— Select and sequence content 

— Select an instructional strategy 

m Develop augmented reaUty firefighter traimng system software and hardware 

— Develop/implement an accurate position tracking system 

— Develop/implement capability for mixing real and virtual imagery 

— Develop/implement capability for anchoring virtual objects in the real world 
Develop/implement models for occluding real objects by virtual objects and virtual 

objects by real objects 

— Develop/implement technology to display augmented reaUty scenes to the firefighter 
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— Develop/implement models for fire, smoke, water, and steam 

— Perform system integratioii of the above (See FIG 8) 

• Establish traming system validity 

— Test & evaluate 

The opportunity identified above amounts to an assessment of training needs of 
firefighters tempered by the realities of state-of-the-art technologies. 
The issues in this needs assessment include: 

• Sensoiyrepresentations of fire and smoke 

• Real-time presentation of those sensoiy representations 

• Modeling of fire spread 

• Instructor authoring of fire training exercises 

We consider pre-flashover compartment fires in an effort to demonstrate feasibility of our 
approach to a training system. Flashover refers to the point in the evolution of a 
compartment fire in which the fire tiansitions fiom local burning to mvolvement of the entire 
compartment 

One of the key elements of our approach is the precomputation of fire dynamics. We 
have elected to use a zone-type fire model. A zone-lype fire model should provide sufficient 
accuracy for meeting our tiaining objectives. There are a number of zone models available, 
including the Consolidated Fire and Smoke Transport Model (CFAST) from NIST and the' 
WPI fire model from Worcester Polytechnic Institute, among others. 

TTie outputs of a zone-type fire model can be extended to achieve a visual representation 
of a compartment flie. 



I?^}^ Examples of Real World Actions and Augmented WnrlH Ffifo^tc ^ pi^^Hl 
FxghtmsTratninpScenari^^^ -I^e Self-Contained Augmented ReaHty traming 
mvention wiU provide real-world experiences like these 
1 REALITY 1 ATJGVrFTsiTPnpprATTTY 1 


1^ eel real wails 
Turn real doorknobs 

1 Crawl 


See virtual fue near the real ceiling 

Hear virtual roaring fire on other side of door 

Experience virtual smoke pour out 


1 Climb real stairs 


Keep below virtual smoke layer of 2 feet above floor " 

See me loss of visibility at top of virtual smoke-filled stairway — 
Maybe smeH virtual smoke if vour SCBA is ill-fitted | 


j View a real aircraft on 
real tarmac of runway 


see vutual smoke and fire and locate real rescue points 1 


Enter real aircraft, 
physically perform a 
rig^t-hand search 
1 pattern 


Navigate among virtual smoke and fire fiUed ftiselage 1 
Attempt search and rescue while virtual fire advances on your 1 
position 1 

Make error in right-hand search and become disoriented 1 
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Experience claustrophobia as time an your SCUA runs out and 
visibility decreases ^ ^ 

Experience stress when your SCBA "malfunctions (via 
instructor radio remote control) 



Task 1. Infrastructure for Real-Time Display of Fire 

T..k Summary. The organization and structuring of information to be displayed is as 

important as actual display processing for real-time dynamical presentation of augmented 
enviromnents. As a firefighter moves through a scenario (using an augmented reality device) 
the location, extent, and density of fire and smoke change. From a computational 
perspective, an approach is to examine the transfer of data to and ftom 4e hard disk, through 
system memory, to update display memory with Ihe desired ftequency. 
Ap p.n,.h to This Task. Precomputation of the bulk of a firefi^ter training shnulation, 
implies that most of the operations involved in real-time presentation of sensory information 
revolve around data transfer. In order to identify bottlenecks and optimize information 
throughput, it is advantageous to analyze resource allocation in flie context of some systems 
model, such as queuing theory. Given such an analysis, we may tfien implement data 
structures and the memory management processes that form what we caU the infiastnicture 
for real-time presentation of sensory information. 

nuk>, and Risk Management The risks inherent in tins task arise ftom unrecognized or 
umesolved bottlenecks remaining m our infifastnicture for real-time presentation of sensory 
information. This risk is managed in our approach by thorough analysis of resource 
allocation requirements prior to commitment m software of any particular data management 
configuration. Furthermore, subsequent tasks build on Hda infiastmcture and therefore con- 
tinue the process of challenging and reinforcmg our approach to an infrastructure for real- 
time presentation of sensory information. 

TVf.«snres of Success. Completion of tins task can be recognized by 4e existence of a fidly 
implemented and tested data management system. The level of success achieved for this task 
can be directly measured in terms of data ftrougl?)ut relative to system requirements. 

Task 2. Visual Representation of Smoke and Fire 
Task Summary. The way in which sensory stimnU are presented m an ARBT scenario may 
or may not effect task performance by a student It is essential to capture the aspects of the 
sensory representations of fire and smoke that affect student behavior in a training scenario 
without the computational encumbrance of those aspects that do not affect behavior. For the 
purposes of providing sensory stimuU for firefighter training, we need to know not only the 



30 



^OiWmSOSl PCT/US02/25065 
spatial distribution and time evolution of temperature and hot gases in a compartment fire, 
but also the visible appearance of smoke and flame, along with sounds associated wiA a 
burning compartment, taken over time. There are three tiers of attributes of fire and smoke: 

• First tier location and extent 

• Second tier opacity, luminosity, and ^mamics 

• Third tier illumination of other objects in the scene 

AfiSroacb. Part of the rationale behind the problem identified above is the degiee to which 
the time- and 31>-^e-dependent elements of a desired scenario for a compartment fire can 
be precomputed. TTie visual representations of fire and smoke can be precompuled. In order 
to do so. and still retain real-time effects, the appearance of the fire and smoke ftom 
reasonable vantage points within the compartment would be determined. As a firefighter 
moves through a training simulation, the appropriate data need only be retrieved in real time 
to provide the necessary visual stimulation. 

The emission of visual Kght ftom flame and the scattering and absorption of light by 
smoke is to be modeled. A zone-type fire model can be used to determine the location and 
extent of the smoke and flame. In addition to these quantities, tbe zone-type fire model also 
win yield aerosol densities in a given layer. Values for optical transmission through smoke 
can be cakulated using a standard model such as found in the CFAST (Consolidated Fire and 
Smoke Transport) model, or in the EOSAEL (Electro-Optical Systems Atmospheric Effects 
Library) code. 

It is thought that the intermittent flame region in a fire oscillates with regularity, and that 
the oscillations arise ftom instabilities at the bomidary between die fire plmne and the sur- 
romiding air. The instabilities generate vortex stinctures in die flame which in turn rise 
through the flame resulting in observed oscillations. For the purposes of this description, the 
visual dynamics of flame can be modeled ftom empirical data such as is known in the art. 
Measures of Sncce^. . This task can be judged on the aesdietics of flie visual appearance of 

the simulated fire and smoke. Ultimately, the visual appearance of fire and smoke should be 

evaluated relative to die efficacy of an ARBT system. 

Tasks. Position Anchoring 

Task Summary. Augmented reality techniques rely on superimposing information onto a 

physical scene. Superposition means that infommtion is tied to objects or events in the scene. 

As such, it is necessary then to compensate for movement by an observer in order to maintain 
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the geometric lelations between superimposed infimnation and underlying physical structures 
in the scene. 

Approach. Position sensors in the form of a head tracker can. in real-time, calculate changes 
in location caused by movement of a firefighter within a training scenario. Virtual objects 
will be adjusted accordingly to remain "fixed" to the physical world. 

Ri^iks and Risk Management. Rapid movements by an observer can cause superimposed 
information to lag behind the apparent motion of objects in the field of view. This lag may 
result in the feeling that the superimposed information is floatmg independent of the scene 
rather than remaining anchored to a specific position, hi severe cases the lag in motion 
compensation may result in a form of simulator sickness which arises when conflicting 
motion information is received by the brain. In order to mhnmize this effect, we can again 
consider tiie complexity of the visual presentation of augmented mformation. (It may also be 
possible to essentially blank out the augmented information until observer movement 
stabilizes.) 

At<>asiircs of Success. Anchoring virtual flame and smoke to a specified position in a real 
room witii nunimal motion lag signals the completion of this tadc 

Task 4. Authoring Tools 
s..itiniflrv. The hnplementation of any sort of authoring tool for instiiictors to create 
training scenarios is beyond the scope of this description. However, because we do envision 
the creation of a prototype autiioring system, this task is devoted to the investigation of issues 
and characteristics involved. An authoring system typically takes the form of a visual 
programming interface over a modular toolkit of fundamental processes. A traming 
insteuctor can use an authoring tool to visually select and sequence modules to create die 
desired training course witiiout ever having to resort to direct programming in some computer 
language such as C or FORTRAN. 

Approacli. Autiioring tools do exist for construction of general, business-oriented, 
computer-based training. Examination of successful attempts can serve as an instractive 
guide to specification of an authoring system supporting ARBT for firefighters. 
yisks and Pi^fc Management. Although there is no risk, per se, inherent in this task, 
autiioring any real-time system is problematic. An autiioring system relies on tfie existence 
of independent modules that are executed through a central control facility. If flie control 
module handles all data traffic, tiien botflenecks may occur fliat would not necessarily exist in 
an optimized, real-time system. 
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Measures of Snccess . This task leads into development for instructors of an authoring 
system for an ARBT system for firefighters. The measure of success then Ues in the 
coverage of issues pertaining to 

• Authoring of real-time systems 

• Commercially available authoring tools or systems 

Task 5. ARBT Technology Demonstration 
Task Summary. The previous tasks herein developed the pieces of an augmented reality fire 
simulation. It remains to puU eveiyfliing together into a coherent demonstration to show the 
suitabiUty of the selected technologies to the delivery of training to firefighters. 
AEEoach. A scenario consisting of a real room and virtual fire is to be constructed, and a 
problem solving situation will be presented to prospective trainees. 

Risks and Risk Management . The obvious risk is thatthe virtual fire and smoke training 
demonstration scenarios do not achieve adequate reaUsm to an experienced firefighter. 
Measures of Snccew . The real measure of success for this task lies in the realism perceived 
byatrainee. In order to judge the success of flie demonstration, the users wiH evahiate the 
effectiveness of the simulation. 
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APPENDIX A 

Tt. descriptions in this Appendix contain parameters that may be used to descr.be the 
behavior of particle systems used to represent Ae following phenomena: 

• Flames 

• Smoke plume 

• Smoke with random motion to be used in the upper layer 

• Steam 

• Water spray from a vari-nozzle 
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Default Fire Parameters 

System Type: Faded, Directional Quads 

Emitter Shape: Rectangular 

Global Force Vector (Lhf): 0.0, LOO, 0.0 

Particle Mass: 0.2 Ibm 

Mass Variance: 0.0 

Yaw: 0.0 radian 

Yaw Variance: 6.28 radian 

Pitch: 0.0 radian 

Pitch Variance: 0.05 radian 

Initial Speed: 0.65 fl/s 

Initial Speed Variance: 0.05 fi/s 

Emission Rate: 750 particles/sec 

Emission Rate Variance: 500 particles/sec 

Life Span: 1.3 sec 

Life Span Variance: 0.1 sec 

Start Color (RGBA): 1.0, 1.0, 1.0, 0.0 

Middle Color (RGBA): 1.0,1.0,1.0.1.0 

End Color (RGBA): LO, 1.0, 1.0, 0.0 

Random Force: 0.45 Ibf 

Start Scale: LQ 

End Scale: 1.0 
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Default Smoke parameters 

System Type: Billboard 

Emitter Shape: Rectangular 

Global Force Vector Qbf): 0.0, 1.00, 0.0 

Particle Mass: 0.2 Ibm 

Mass Variance: 0.05 

Yaw: 0.0 radian 

Yaw Variance: 6,28 radian 

Pitch: 1.2 radian 

Pitch Variance: 0.393 radian 

Initial Speed: 0.2ft/s 

Initial Speed Variance: 0.0 ft/s 

Emission Rate: 10.0 particles/sec 

Emission Rate Variance: 0.25 particles/sec 

Lifespan: 3.25 sec 

Life Span Variance: 0.25 sec 

Start Color (RGBA): 1 .0, 1 .0, 1 .0, 0.0 

Middle Color (RGBA): 1.0, 1.0, 1.0, 0.85 

End Color (RGBA): 1 .0, 1 .0, 1 .0, 0.0 

Random Force: 0.4 Ibf 

Start Scale: 0.105 

End Scale: 4.2 
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Default Layer Smoke Parameters 

System Type: Billboard 

Emitter Shape: Rectangular 

Global Force Vector (Ibf): 0.0, 0.025, 0.0 

Particle Mass: 0.2 Ibm 

Mass Variance: 0.05 

Yaw: 0.0 radian 

Yaw Variance: 6.28 radian 

Pitch: 1.2 radian 

Pitch Variance: 0.393 radian 

Initial Speed: O.Ofl/s 

Initial Speed Variance: 0.0 ft/s 

Emission Rate: 35.0 particles/sec 

Emission Rate Variance: 5.0 particles/sec 

Lifespan: 4.0 sec 

Life Span Variance: 0.5 sec 

Start Color (RGBA): 1.0, 1.0, 1.0, 0.0 

Middle Color (RGBA): 1.0,1.0,1.0,1.0 

End Color (RGBA): 1.0, 1.0, 1.0, 0.0 

Random Force: 0.35 Ibf 

Start Scale: 1.75 

End Scale: 3.75 
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Default Steam Parameters 

System Type: Billboard 

Emitter Shape: Rectangular 

Global Force Vector (Ibf): 0.0,0.4,0.0 

Particle Mass: 0.2 Ibm 

Mass Variance: 0.05 

Yaw: 0,0 radian 

Yaw Variance: 6.28 radian 

Pitch: 1.2 radian 

Pitch Variance: 0.393 radian 

Initial Speed: 0.6ft/s 

Initial Speed Variance: O.Oft/s 

Emission Rate: 50.0 particles/sec 

Emission Rate Variance: 10.0 particles/sec 

Life Span: 2.5 sec 

Life Span Variance: 0. 5 sec 

Start Color (RGBA): 1 .0, 1 .0, 1 .0, 0.0 

Middle Color (RGBA): 1 .0, 1 .0, 1 .0, 0.45 

End Color (RGBA): 1,0, 1.0, 1.0, 0.0 

Random Force: 0.25 Ibf 

Start Scale: 0.7 

End Scale: 2.8 
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Default Water Stream Parameters 

System Type: Surface 

Emitter Shape: Spherical 

Global Force Vector (Ibf): 0.0, -2.11, 0.0 

Particle Mass: 0.0656 Ibm 

Mass Variance: 0.005 

Initial Speed: 162.0 JB/s 

Initial Speed Variance: O.Ofl/s 

Life Span: 4.5 sec 

Life Span Variance: 0.4 sec 

Start Color (RGBA): 0.65,0.65, 1.0, 1.0 

Middle Color (RGBA): 0.65, 0.65, LO, 0. 5 

End Color (RGBA): 0.75, 0.75, 1.0, 0.0 

Random Force: 0.15 Ibf 
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Although specific features of the mvention are shown in some drawings and not others, 
this is for convenience only, as each feature may be combined with any or all of flie other 
features in accordance with the invention. 

Other embodiments will occur to those skilled in the art and are within the following 

claims. 

What is claimed is: 
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CLAIMS 

1. A method of accompUshing an augmented reality firefighter training system for a user, 
comprising: 

providing a head-worn display unit 

providing a real device that flie user can operate to simulate applying extinguishing 
agent, to be carried by the user during firefighter training; 

providing motion tracking hardware, and attaching it both to the head-worn display 
unit and the extinguishing agent device; 

using the motion tracking hardware that is attached to the head worn unit to determine 
the location and direction of the viewpoint of the head-wom display unit; 

using the motion tracking hardware that is attached to the extinguishing agent device 
to detemiine the location and direction of the extinguishing agent device; 
determinmg the operating state of the extinguishing agent device; 
using a computer to generate graphical elements comprismg simulated fire graphical 
elements, simulated multiple byer smoke obscuration graphical elements, and simulated 
application of an extinguishing agent, showing the extinguishing agent itself emanating 
directly fiom the extinguishing agent device, and showing the interaction and extinguishing 
of the agent wifli the fire and airborne particles in ±e system; 

rendering the generated graphical elements to correspond to the user's viewpoint; 
occluding graphical elements fiom the user's viewpoint which are blocked by selected 
persons or objects; and 

creating for the user a mixed view comprised of an actual view of the real world as it 
appears in fiont of the user, where graphical elements can be placed any place in the real 
world and remain anchored to that place in the real world regardless of fee direction in which 
the user is looking, wherein the rendered gr^hical elements are superimposed on the actual 
view, to accomplish an augmented reaUty view of fire and smoke in the real world, and the 
application of extinguishing agent to the fire, and the effect of extinguishing agent on the fire. 

2. A method of generating a three^ensional fire and smoke plume for graphical display, 
comprising: 

employing a first particle system for lower persistent flames; 
employing a second particle system for upper intermittent flames; 
texture mapping both of said particle systems; 

giving flame particles an impetus towards the flame center to simulate air 
entrainmen^ and 
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employing a third particle system for a buoyant smoke plume. 
3. A method ofsimulating multiple layer obscuration fix>m a viewpoint 

displaying polygonal representations of objects; 

calculating transmittance along a vector from the viewpoint to the polygons; 
applying said transmittance, original polygon color, and obscuration color to recolor 

the polygons; and 

modifying said transmittance to represent light sources. 

4. A method of simulating flow of an extmguishing agent ftom a fire hose or other agent 
application means for graphical display, comprising: 

employing at least one particle system to simulate physical behavior of an 

extinguishing agent stream; 

organizing particles into regularly spaced rings; 

using particle locations as polygon vertices to create a surface; 

texture mapping said surface; and ' 

movmg said texture map in the direction of extinguishing agent flow to simulate 
extinguishing agent flow- 

5. The method of claim 1 in which flame height and smoke layer parameters of the graphical 
elements are controlled by output from a zone fire model. 

6. The method of claim 1 in which the simulated fire graphical elements are generated by: 

employing a first particle system for lower persistent flames; 
employing a second particle system for upper mtermittent flames; 
texture mapping both of said particle systems; 

giving flame particles an impetus towards the flame center to simulate air 
entrainment; and 

employing a third particle system for a smoke plume. - 

7. The method of claim 1 m which the smoke obscuration graphical elements rendering is 

accomplished by: 

displaying polygonal representations of objects; 

calculating transmittance along a vector from the viewpoint to the polygons; 
applying said transmittance, original polygon color, and obscuration color to recolor 

the polygons; and 

modifying said transmittance to represent light sources. 

8. The method of claim 1 in which the extinguishing agent is simulated using the foUowing 
method: 
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employing a particle system to simulate physical behavior of an extinguishing agent 

stream; 

organizing particles into regularly spaced rings; 

using particle locations as polygon vertices to create a sur&ce; 

texture marking said sui&ce; and 

moving said texture map in the direction of extinguishing agent flow to simulate 
extinguishing a^nt flow. 

9. The method of claim 1 in >!siiich real-world imageiy is provided by a head-worn camera. 

10. The method of claim 9 in which leal-world imagery and the rendered graphical elements 
are mixed via a luminance key in a video mixer. 

1 1. The method of claim 10 in which a separate image indicating the transparency of the 
rendered graphical elements is generated and used as an external key. 

12. The method of claim 9 in which real-world imagery and the rendered graphical elements 
are mixed on a computer using a transparency (alpha) channel for blending. 

13. The method of claim 1 in which real-world imagery and (he rendered graphical elements 
are combined on an optical see-through head-worn display. 

14. The method of claim 4 where a particle system is additionally used to represent water 
droplets. 

15. The method of claim 2 in which particles are represented by billboarded, textured, 
polygons wifli opaque centers and less opaque or transparent edges. 

1 6. The method of claim 1 in which multiple trainees with similar apparatus can view and 
interact wift the same fire scenario. 

1 7. The method of claim 2 in which graphics display depth buffer writing is disabled to 
improve blending or particles without ordering particles fiom back to fiont 

18. The method of claim 2 further including placing an apparent light source at the flame 
location. 

1 9. The method of claim 18, further including fluctuating the apparent light source 
synchronously wiA emissions of the intermittent flames. 

20. The method of claim 2 in which the smoke particles are textured, spherically biUboarded 
particles. 

21. The method of claim 2 in which a drag force is used to create particle acceleration in the 
persistent flame, near-constant particle velocity in the intermittent flame, and deceleration in 
tbe smoke plume. 
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22. The method of claim 2 in which the flames have a base area, and the intMmittent flames 
are displayed with intermittence that is based on the area of the flame base. 

23. The method of claim 2 in which flames have a base area that is represented by a grid of 
smaller sub-areas. 

24. The method ofclaim23 in whichheightofflamesemanatingftomeachsub-area is 
separately controllable. 

25. The method of claim 3 further including displaying a bUIboarded, texture-mapped 
polygon to simulate the diffuse glow of a Ught source Ihrou^ obscuration. 

26. The method of claim 3 further including employing a smoke particle system for an upper 
smoke layer. 

27. The method of claim 4 in which there are surfeces in the display, and wherem the 
intersection of a water stream with a surface generates steam particles. 

28. The method of claim 4 in which intersection of the extinguishing agent stream with a 
flame base grid sub-area is determined, and used to reduce Ae height of «» flames emanating 
firom that sub-area. 

29. The method of claim 24 in which intersection of the extinguishing agent stream with a 
flame base grid sub-area is determined, and used to reduce the height of the flames emanating 
from that sub-area. 

30. The method of claim 29 in which flame height is reduced to zero in a specified extinguish 
time if extinguishing agent is applied constantly. 

3 1 . The method of claim 30 in which extinguishing agent must be appUed for a specified soak 
time after flame height has been reduced to zero. 

32. The method of claim 3 1 in which flames reflash and grow after a specified reflash time if 
extinguidiing agent appUcation is stopped before the specified amount of soak time. 

33. The method of claim 4 in which there are polygonal models in the display, and wherein 
die extinguishing agent particles' colUsion with a polygonal model are determined, and the 
direction of movement of the extinguishing agent particles is changed accordingly based on 
particle elasticity. 

34. The metiiod of claim 4 in which two rings of particles are emitted to create an outer and 
inner sur&ce. 

35. The method of claim 34 in which the outer suifece is given a different, more transparent 
texture than the inner surface in order to mask the surface edges. 

36- The metfiod of claim 2 in which of at least one of the height of the persistent flame region 
and the height of the intermittent flame region is controllable. 
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37. The method of claim 2 in which said texture map is projected through the flame particle 
systems and rotated about a vertical axis. 

38. The method of claim 3 where layer heights and optical densities are separately controlled. 

39. The method of claim 25 where the height and width of the glow polygon are related to the 
height and width of the light source. 

40. TTie method of claim 3 where the light source intensity is specified with a luminosity 
color component 

41 . The method of claim 2 where any or aU particle systems are tested for collision with a 
geometric model and the direction of movement of the particles is changed accordmgly based 
on particle elasticity. 

42. The method of claim 1 further comprising creating a geometric representation of real- 
world objects and using the geometric representation to o<?clude the computer-generated 
graphical elements so as to allow fliem to appear appropriately behind or in fiont of real- 
world objects. 

43. The method of claim 1 in which the rendering conqnises matching the user's virtual eye 
location and field of view to the user's real eye location and field of view. 

44. The method of claim 1 in which view fiiistum culling is appKed to the computer- 
generated graphical elements to optimize graphics performance. 

45. The method of claim 33 in which collision is detected by testing every particle with aU 
polygons that they may collide with. 

46. The method of claun 33 in which selected particles are tested for collision with selected 
polygons in order to improve speed. 

47. Tlie mefliod of claim 46 in which space is partitioned into a 3-D grid m order to limit the 
number of polygons and particle pairings fliat are tested for coUision- 

48. TTie mediod of claim 46 in which space is partitioned using a binary space partition (BSP) 
tree approach in order to determine which particles to test for collision with which polygons. 

49. The method of claim 46 in which space is partitioned using an octree space partition 
(OSP) tree approach in order to determine which particles to test for coUision with which 
polygons. 

50. The method of claim 33 in which collision is determined by setting axis-aUgned 
minimum and maximum bounds for particle motion. 

51. The method of claim 41 in which collision is detected by testing every particle with aU 
polygons that diey may collide wifli. 
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52. The method of claim 41 in which selected particles are tested for collision with selected 
polygons in order to improve speed. 

53. The method of claim 52 in which space is partitioned ioto a 3-D grid m order to limit tiie 
number of polygons and particle pairings that are tested for collision. 

54. The method of claim 52 in which space is partitioned using a binary space partition (BSP) 
tree approach in order to deteraiine which particles to test for coUision with which polygons. 

55. The method of claim 52 in which space is partitioned using an octree space partition 
(OSP) tree approach in order to determine which particles to test for collision wiA which 
polygons. 

56. The method of claim 41 in which collision is determined by setting axis-aligned 
minimum and maximum bounds for particle motion. 

57. The method of claim 1 in which tbe device that the user can operate to simulate applying 
extinguishing agent is instnmiented to aUow adjustment of the flow rate and fog pattem of 
the computer-generated extinguishing agent. 

58. The method of claim 2 in which smoke particles are given the properties of volume and 
optical density in order to facilitate accumulation of a smoke layer. 

59. The method of claim 2 in which the motion of particles can be affected by an external 
force such as airflow through a vent or extinguishing agent flow fixwn a nozzle. 

60. The method of claim 5 in which the upper layer temperature is monitored and an 
indication of flashover is displayed when it is predicted to occur. 

61 . The method of claim 1 further comprising attaching audio to the location of objects in the 
mixed view. 

62. The method of claim 61 in which the volume of the audio increases with fire size. 

63 . The method of claim 2 in which in which flame height is controlled by output from a 
zone fire model. 

64. The method of claim 3 in which in which smoke layer parameters are controlled by 
output firom a zone fire model. 

65. The method of claim 1 further comprising periodically updating the prediction amoxmt for 
motion tracking based on display firame rate in order to best anchor graphical elements in the 
real environment 

66. A method of calculating in real-time a force to apply to components in a computer 
simulation to simulate the effects that an extinguishing agent stream has on the airflow in the 
vicinity of the stream. 
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67. The method of claim 66 wherein the said simulation components are selected from tbs 
group of simulations consisting of fire plumes, smoke plumes, ambient steam, ambient 
smoke, fumes, other aerosols, gases, and particulate matter. 

68. The method of claim 66 where the said computa simulation components are particle 

systems. 

69. The method of claim 66 where a particle system is used to simulate the extinguishing 

agent 

70. The method of claim 66 where multiple layers of cones of extinguishing agent are used to 
simulate multiple levels of force to apply to the simulation components. 

71 . The method of claim 70 where the appHed force varies from cone layer to cone layer in 
order to accelerate the components of the simulation towards the velocity of the extinguishing 
agent stream in Has cone layer. 

72. The method of claim 69 where the extinguishing agent particle mass, type, particle 
velocity, and distance from extinguishing agent particles to other particles are used to 
detennine a foroe to apply to simulation conqionents. 

73. The method of claim 66 where the results of the calculations are used to graphically 
simulate the effects of the extinguishing agent stream on the components of the simulation. 
74 A method of occluding virtual objects with a real world human in augmented reality 
comprising: 

Creating an orthogonal plane billboard with soft texture edges representing a user's head; 
Creating an orthogonal plane billboaid with soft texture edges representing a user's torso; 
Positioning and orienting the head billboard using motion tracker data; 
Positioning and orienting the torso billboard relative to the head billboard; 
Displaying the head and torso billboards in real-time 3-D to correspond to the location of 
a real person; ami 

Mixing the resulting image with a live image of a real person. 
75 A method of occluding virtual objects with a movable real-world physical object in 
augmented reality conqnising: 

Creating an orthogonal plane bUlboard with soft texture edges representing flie object; 
Positioning and orienting the object billboard using motion tracker data; 
Displaying the object billboard in real-time 3-D to correspond to the location of the 
object and 

Mixing the resulting image with a live image of the real object 
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76 The method of Claim 75 in which the movable real world physical object has a joint 
connecting two parts, one part of which is tracked and the other part of which is coraiected to 
the first part by a joint but which is not separately tracked. 

77. The method of claim 1 in which said head worn display mrit (HMD) is integrated into a 
self contained breathing apparatus (SCB A) mask and a motion tracker. 

78. The method of claim 77, wherein the HMD is non-see-toough, and further comprising a 
head-mounted camera. 

79. The mefliod of claim 77 in which flie HMD is a see-through display. 

80. The method of claim 78, further comprising one or two mirrors to set the camera 
viewpoint to more closely coincide with the wearer's eye position. 

8 1 . The method of claim 78, further comprising a head-mounted camera for generating a 
stereoscopic view. — 

82. The method of claim 8 1 , further comprising one or two mirrors to set the camera 
viewpoints to more closely coincide with the wearer's eye positions. 

83. The method of claim 77, further comprising headphones. 

84. The method of claim 83, further comprising shafts to connect the headphones to the 
SCBA, and wherein the shafts are filled with epoxy or odier means to strengthen the shafts. 

85. The method of claim 80, further comprising a robber bumper placed around flie mirror or 
mirrors. 

86. The method of claim 82, ftirther comprising a rubber bumper placed around the mirror or 
mirrors. 

87. The method of claim 80 wherein each mirror is placed in a mechanical clamp mount 

88. The method of claim 82 wherein each minor is placed in a mechanical clamp mount 

89. The method of claim 80, furflier comprising a structure for protecting each mirror from 
being bumped or hooked. 

90. The method of claim 82, further comprising a structure for protecting each mirror from 
being bumped or hooked. 

9 1 . The method of claim 80 wherein each mirror is mounted on a mounting plate. 

92. The method of claim 82 wherein each mirror is mounted on a mounting plate. 

93. The method of claim 77 wherein the non-augmented reality portion of the user's field of 
view is blocked with opaque materials from view by the user such diat only augmented 
reality imagery is visible to die user. 
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94. The method of claun 93 wherein the said opaque materials are selected ftom the group of 
materials consisting of tape, foam, plastic, rubber, siKcone, paint, and combinations of these 
materials. 

95. The method of clam 1 in which the extinguishing agent device is ruggedized, and 
cominises: 

an instrumented firefighter's vari-nozzle wifli a pattern selector and bail; and 

a covering device which protects said nozde and said instrumentation from shock and 

environmental hazards 

96. The ruggedized instrumented firefighter's vari-nozzle of claim 95 in which said 
instrumented nozzle is instrumented for measuring said nozzle pattem selector position. 

97. The mggedized instnmiented firefighter's vari-nozzle of claim 95 in which said 
instrumented nozzle is instrumented for measuring said bail angle. 

98. The mggedized instramented firefighter's vari-nozzle of claim 95 in which said 
instrumented nozzle instrumentation is for tracking or measuring the position and orientation 
of said nozzle. 

99. The mggedized instrumented firefighter's vari-nozzle of claim 95 in which said covering 
device holds said instrumentation such that said instrumentation sits on a floating island to 
provide shock protection. 

100. The ruggedized instrumented firefighter's vari-nozzle of chiim 99 in which said island 
. is supported by at least one soft post 

101 . The mggedized instrumented firefighter's vari-nozzle of claim 99 in which said island 
is protected finm lateral shock and motion by a soft barrier. 

102. The mggedized instrumented firefighter's vari-nozzle of claim 95 in which a soft 
bumper is placed on at least one comer of said covering device to protect said comer from 
shock. 

103. The mggedized instrumented firefighter's vari-nozzle of claim 95 in which said 
covering device has a color scheme that indicates that said nozzle is to be used for training 
puiposes. 

104. The mggedized instrumented firefighter's vari-nozzle of claim 95 in which said 
covering device has signage which indicates that said nozzle is to be used for training 
purposes. 

105. The mggedized instmmented firefighter's vari-nozzle of claim 95 in which said 
instrumentation is electronically connected at one location by a single connector. 
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106. The ruggedized instxumented ftofightefs vari-nozzle of claim 105 in which said 
single connector has soldering posts for connections. 

107. Ihe ruggedized inslxumented firefighter's vari-nozzle of claim 105 in which said 
single connector has screw down connections. 

108. The ruggedized instrumented firefighter's vari-nozzle of claim 105 in which said 
single connector has quick-release connections. 

109. The ruggedized instnimented firefighter's vari-nozzle of claim 95 m which said 
covering device also provides protection against water, dirt, and contaminant penetration. 

110. The ruggedized instrumented firefighter's vari-nozde of claim 95 in which afl 
instrumentation comiecting wires exit the instmmented vari-nozzle through the nozzle-hose 

interface. 

111. The mggedized instmmented firefighter's vari-nozzle of claim 95 in which all wires 
and instnnnentation. except those which must be exposed in order to fimction properly, are 
hidden from view by said covering device. 

112. The mggedized instrumented firefighter's vari-nozzle of claim 95 flirflier comprising 
computer equipment not carried by the user and a wireless system to provide an electronic 
connection for the instrumentation to the computer equipment . 

113. The ruggedized instrumented firefighter's vari-nozzle of claim 98 in which said 
tracking equipment comprises a microphone. 

114. The ruggedized instnmiented firefighter's vari-nozzle of claim 98 in which said 
tracking equipment comprises a speaker. 

115. The ruggedized instrumented firefighter's vari-nozzle of claim 98 in which said 
tracking equipment comprises an optical receiver. 

116. The method of claim 1 fbrther comprising a ruggedized firefighter's Self Contained 
Breathing Apparatus (SCBA) instrumented with electronic and passive equipment. 

comprising: 

an instrumented firefighter's SCBA; and 

a covering device which protects said SCBA and said instrumentation from shock and 
environmental hazards 

117. The ruggedized firefighter's SCBA of claim 116 in which the instrumentation 
comprises a Head Mounted Display (HMD). 

118. The mggedized firefighter's SCBA of claim 1 17 in which the HMD is a non-see- 
through HMD. 
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1 19. The ruggedized firefighter's SQ3A of claim 1 17 in which the HMD is a see-through 
HMD. 

120. The ruggedized firefighter's SCBA of claim 116 in which the instrumentation 
comprises tracking equipment that measures the position and orientation of die equipment 
mounted on the SCBA. 

121. The mggedized firefighter's SCBA of claim 116 in which the instrumentation 
comprises a camera. 

122. The ruggedized firefighter's SCBA of claim 121 in which the camera is used to 
acquire an image of the real world in the user's field of view. 

123. The raggedized firefighter's SCBA of claim 122 further comprising means for 
shifting the image acquired by the camera. 

124. The ruggedized firefighter's SCBA of claim 116 in which the instrumentation 
comprises an image shifter. 

125. The mggedized firefighter's SCBA of claim 124 in which the image shifter comprises 
a prism. 

126. The mggedized firefighter's SCBA of claim 124 in which flie image shifter comprises 
a set of two mirrors. 

127. The mggedized firefighter's SCBA of claim 126 in which the mirrors are made of 
plastic. 

128. The mggedized firefighter's SCBA of claim 126 in which die mirrors are made of 
glass. 

129. The mggedized firefigihter's SCBA of claim 126 in which the minors are made of 
metal. 

130. The mggedized firefighter's SCBA of claim 116 in which the covering has a color 
scheme that indicates ^t the SCBA is to be used for training puiposes. 

131. The mggedized firefighter's SCBA of claim 1 16 in which the covering has signage 
which indicates that the SCBA is to be used for training purposes. 

132. The mggedized firefighter's SCBA of claim 116 in which die instrumentation is 
connected via a cable to the instrumentation's associated computer equipment at one location 
by a single connector. 

133. The mggedized firefighter's SCBA of claim 132 in which the single connector has 
soldering posts for connections. 

134. The mggedized firefighter's SCBA if claim 132 in which the single connector has 
screw down connections. 
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135. The ruggedized fcefighter's SCBA of claim 132 in which the single connector has 
quick-release connections. 

136. The ruggedized firefighter's SCBA of claim 116 in which the covering device also 
provides protection against water, dirt, and contaminant penetration. 

137. The mggedized firefighter's SCBA of claim 116 in which all wires and 
instrumentation are hidden &om view by the cover and the SCBA. 

138. The mggedized firefighter's SCBA of claim 124 in which flie image shifter comprises 
one mirror. 

139. The mggedized firefighter's SCBA of claim 138 in which the mirror is made of glass. 

140. The mggedized firefighter's SCBA of claim 138 in which the mirror is made of 
plastic. 

141. The mggedized firefighter's SCBA of claim 138 in which flie mirror is made of metal. 

142. The mggedized firefighter's SCBA of claim 138 in which the image shifter further 
comprises an electronic means for reversing the image, to achieve the affect that two mirrors 
have, ensuring that the image is upright and not reversed. 

143. The mggedized firefighter's SCBA of claim 1 16 in which the covering device defines 
air holes to provide cooling of tiie components. 

144. The mggedized firefighter's SCBA of claim 1 16 further comprising means to use the 
broatibing action of the user to draw air over the electronic equipment to provide cooling of 
the components. 

145. The mggedized firefighter's SCBA of claim 116 fur&er comprising computer 
equipment not worn by the user, and a wireless system to provide an electronic connection 
for the equipment on the SCBA to the computer equipment. 

146. The mggedized firefighter's SCBA of claim 120 in which the tracking equipment 
comprises a microphone. 

147. The mggedized firefighter's SCBA of claim 120 in which the tracking equipment 
comprises a speaker. 

148. The mggedized firefighter's SCBA of claim 120 in which the tracking equipment 
comprises an optical receiver. 

149. The mggedized firefighter's SCBA of claim 122 in which flie instrumentation defines 
two optical paths that are used to produce a stereo simulation to the user. 

150. The mggedized firefighter's SCBA of claim 149 wherein the instrumentation 
comprises two cameras and two prisms. 
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